A Hybrid Decision Tree and Deep Learning Approach Combining Medical Imaging and Electronic Medical Records to Predict Intubation Among Hospitalized Patients With COVID-19: Algorithm Development and Validation.

BACKGROUND: Early prediction of the need for invasive mechanical ventilation (IMV) in patients hospitalized with COVID-19 symptoms can help in the allocation of resources appropriately and improve patient outcomes by appropriately monitoring and treating patients at the greatest risk of respiratory failure. To help with the complexity of deciding whether a patient needs IMV, machine learning algorithms may help bring more prognostic value in a timely and systematic manner. Chest radiographs (CXRs) and electronic medical records (EMRs), typically obtained early in patients admitted with COVID-19, are the keys to deciding whether they need IMV. OBJECTIVE: We aimed to evaluate the use of a machine learning model to predict the need for intubation within 24 hours by using a combination of CXR and EMR data in an end-to-end automated pipeline. We included historical data from 2481 hospitalizations at The Mount Sinai Hospital in New York City. METHODS: CXRs were first resized, rescaled, and normalized. Then lungs were segmented from the CXRs by using a U-Net algorithm. After splitting them into a training and a test set, the training set images were augmented. The augmented images were used to train an image classifier to predict the probability of intubation with a prediction window of 24 hours by retraining a pretrained DenseNet model by using transfer learning, 10-fold cross-validation, and grid search. Then, in the final fusion model, we trained a random forest algorithm via 10-fold cross-validation by combining the probability score from the image classifier with 41 longitudinal variables in the EMR. Variables in the EMR included clinical and laboratory data routinely collected in the inpatient setting. The final fusion model gave a prediction likelihood for the need of intubation within 24 hours as well. RESULTS: At a prediction probability threshold of 0.5, the fusion model provided 78.9% (95% CI 59%-96%) sensitivity, 83% (95% CI 76%-89%) specificity, 0.509 (95% CI 0.34-0.67) F1-score, 0.874 (95% CI 0.80-0.94) area under the receiver operating characteristic curve (AUROC), and 0.497 (95% CI 0.32-0.65) area under the precision recall curve (AUPRC) on the holdout set. Compared to the image classifier alone, which had an AUROC of 0.577 (95% CI 0.44-0.73) and an AUPRC of 0.206 (95% CI 0.08-0.38), the fusion model showed significant improvement (P<.001). The most important predictor variables were respiratory rate, C-reactive protein, oxygen saturation, and lactate dehydrogenase. The imaging probability score ranked 15th in overall feature importance. CONCLUSIONS: We show that, when linked with EMR data, an automated deep learning image classifier improved performance in identifying hospitalized patients with severe COVID-19 at risk for intubation. With additional prospective and external validation, such a model may assist risk assessment and optimize clinical decision-making in choosing the best care plan during the critical stages of COVID-19.

Automatic anatomical labeling of the complete cerebral vasculature in mouse models.

Study of cerebral vascular structure broadens our understanding of underlying variations, such as pathologies that can lead to cerebrovascular disorders. The development of high resolution 3D imaging modalities has provided us with the raw material to study the blood vessels in small animals such as mice. However, the high complexity and 3D nature of the cerebral vasculature make comparison and analysis of the vessels difficult, time-consuming and laborious. Here we present a framework for automated segmentation and recognition of the cerebral vessels in high resolution 3D images that addresses this need. The vasculature is segmented by following vessel center lines starting from automatically generated seeds and the vascular structure is represented as a graph. Each vessel segment is represented as an edge in the graph and has local features such as length, diameter, and direction, and relational features representing the connectivity of the vessel segments. Using these features, each edge in the graph is automatically labeled with its anatomical name using a stochastic relaxation algorithm. We have validated our method on micro-CT images of C57Bl/6J mice. A leave-one-out test performed on the labeled data set demonstrated the recognition rate for all vessels including major named vessels and their minor branches to be >75%. This automatic segmentation and recognition methods facilitate the comparison of blood vessels in large populations of subjects and allow us to study cerebrovascular variations.

A perfusion procedure for imaging of the mouse cerebral vasculature by X-ray micro-CT.

BACKGROUND: Micro-CT is a novel X-ray imaging modality which can provide 3D high resolution images of the vascular network filled with contrast agent. The cerebrovascular system is a complex anatomical structure that can be imaged with contrast enhanced micro-CT. However, the morphology of the cerebrovasculature and many circulatory anastomosis in the brain result in high variations in the extent of contrast agent filling in the blood vessels and as a result, the vasculature of different subjects appear differently in the acquired images. Specifically, the posterior circulation is not consistently perfused with the contrast agent in many brain specimens and thus, many major vessels that perfuse blood to the midbrain and hindbrain are not visible in the micro-CT images acquired from these samples. NEW METHOD: In this paper, we present a modified surgical procedure of cerebral vasculature perfusion through the left ventricle with Microfil contrast agent, in order to achieve a more uniform perfusion of blood vessels throughout the brain and as a result, more consistent images of the cerebrovasculature. Our method consists of filling the posterior cerebral circulation with contrast agent, followed by the perfusion of the whole cerebrovasculature. RESULTS: Our histological results show that over 90% of the vessels in the entire brain, including the cerebellum, were filled with contrast agent. COMPARISON WITH EXISTING METHOD: Our results show that the new technique of sample perfusion decreases the variability of the posterior circulation in the cerebellum in micro-CT images by 6.9%. CONCLUSIONS: This new technique of sample preparation improves the quality of cerebrovascular images.